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CLAIMS 

What is claimed is: 

1. A method in a data processing system including an 
automated software test environment for automatically 
testing a software application, said method comprising 
the steps of : 

establishing a work flow manager for automatically 
managing said automated software test environment, said 
automated software test environment including a plurality 
of computer systems coupled to a server computer system 
utilizing a network, said work flow manager being 
executed utilizing said server computer system; 

establishing a plurality of ordered test phases to 
be executed in a specified order; 

transmitting an event to said work flow manager 
utilizing one of said plurality of computer systems to 
start execution of selected ones of said plurality of 
ordered test phases; and 

controlling execution of said selected ones of said 
plurality of ordered test phases utilizing said work flow 
manager in response to a receipt of events. 

2. The method according to claim 1, further comprising 
the step of executing an initialization test phase 
utilizing said work flow manager in response to a receipt 
of a build event by said server computer system, said 
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build event being generated by one of said plurality of 
computer systems utilized to build said software 
application . 

3. The method according to claim 1, further comprising 
the steps of : 

said step of establishing a plurality of ordered 
test phases further comprising the step of establishing a 
plurality of ordered test phases including an execution 
test phase for executing a plurality of tests on said 
software application; and 

executing a first plurality of said plurality of 
tests in series. 

4. The method according to claim 1, further comprising 
the steps of : 

said step of establishing a plurality of ordered 
test phases further comprising the step of establishing a 
plurality of ordered test phases including an execution 
test phase for executing a plurality of tests on said 
software application; and 

executing a second plurality of said plurality of 
tests in parallel. 

5. The method according to claim 1, further comprising 
the steps of : 

said step of establishing a plurality of ordered 
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test phases further comprising the step of establishing a 
plurality of ordered test phases including an execution 
test phase for executing a plurality of tests on said 
software appl icat ion ; 

executing a first plurality of said plurality of 
tests in series; and 

executing said first plurality of said plurality of 
tests in parallel with a fourth plurality of said 
plurality of tests. 

6. The method according to claim 1, further comprising 
the step of receiving a job description utilizing said 
work flow manager, said job description including an 
identification of said software application and an 
identification of a plurality of tests to be executed on 
said software application. 

7. The method according to claim 1, wherein the step of 
establishing a plurality of ordered test phases further 
comprises the step of establishing an initialization test 
phase for preparing said test environment for testing 
said software application, said initialization test phase 
capable of being executed prior to an availability of 
said software application. 

8. The method according to claim 1, wherein the step of 
establishing a plurality of ordered test phases further 
comprises the step of establishing an installation test 
phase for installing test processes and said software 
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application on said plurality of computer systems. 

9. The method according to claim 1, wherein the step of 
establishing a plurality of ordered test phases further 
comprises the steps of: 

establishing an execution test phase for executing a 
plurality of tests on said software application; and 

establishing a termination test phase for 
terminating said execution of said tests. 

10. The method according to claim 1, further comprising 
the step of specifying an order for executing said 
plurality of ordered test phases including specifying 
completing execution of an initialization test phase 
prior to executing an installation test phase, completing 
execution of said installation test phase prior to 
executing an execution test phase, and completing 
execution of said execution test phase prior to executing 
a termination test phase. 

11. The method according to claim 7, further comprising 
the step of during said initialization test phase prior 
to said software application being available, preparing 
said automated test environment to execute said plurality 
of tests. 

12. The method according to claim 7, further comprising 
the step of generating an initialization event in 
response to a completion of building said software 
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application . 

13. The method according to claim 7, wherein said step 
of prior to said availability of said software 
application, preparing said automated test environment to 
execute said plurality of tests further comprises the 
step of determining an availability of one of said 
plurality of computer system to be utilized to execute 
one of said plurality of tests. 

14. The method according to claim 7, wherein said step 
of establishing an initialization test phase further 
comprises the step of establishing an initialization test 
phase including the steps of: 

executing initialization test phase processes; 

building said software application; and 

copying said built software application to one of 
said plurality of computer systems, wherein said software 
application is available when said built software 
application is copied to one of said plurality of 
computer systems . 

15. The method according to claim 14, further comprising 
the step of generating an installation event in response 
to a completion of said copying said built software 
application to one of said plurality of computer systems 
and a completion of initialization test phase processes. 
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16. The method according to claim 8, wherein said step 
of establishing an installation test phase further 
comprises the step of establishing an installation test 
phase including the step of installing a plurality of 
test cases on one of said plurality of computer systems. 

17. The method according to claim 8, wherein said step 
of establishing an installation test phase further 
comprises the step of installing an operating system 
required to execute one of said plurality of tests on one 
of said plurality of computer systems. 

18. The method according to claim 8, wherein said step 
of establishing an installation test phase further 
comprises the step of installing a plurality of test 
tools required to execute one of said plurality of tests 
on one of said plurality of computer systems. 

19. The method according to claim 9, wherein said step 
of establishing an execution test phase further comprises 
the step of establishing an execution test phase 
including the step of executing said plurality of tests. 

20. The method according to claim 9, wherein said step 
of establishing a termination test phase further 
comprises the step of establishing a termination test 
phase including the step of resetting said automated test 
environment to an original state. 

21. The method according to claim 1, further comprising 
the step of establishing a validation procedure including 
the steps of : 
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suspending execution of said plurality of tests 
prior to a completion of said plurality of tests; and 

providing a notification of said suspension. 

22. The method according to claim 1, further comprising 
the step of establishing a validation procedure including 
the steps of: 

terminating execution of said plurality of tests 
prior to a completion of said plurality of tests; and 

providing a notification of said termination. 

23. The method according to claim 1, further comprising 
the step of establishing a validation procedure including 
the steps of : 

executing a process to determine a result of an 
execution of each said plurality of tests; and 

reporting said result. 

24. The method according to claim 1, wherein said step 
of establishing a plurality of ordered test phases 
further comprises the step of establishing a plurality of 
ordered test phases, at least each of two of said 
plurality of order test phases being executed utilizing 
different ones of said plurality of computer systems. 

25. A method in a data processing system including an 
automated software test environment for automatically 
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3 testing a software application utilizing a plurality of 

4 tests, said method comprising the steps of: 

5 establishing a work flow manager for automatically 
e managing said automated software test environment, said 

7 automated software test environment including a plurality 

s of computer systems coupled to a server computer system 

9 utilizing a network, said work flow manager being 

io executed utilizing said server computer system; 

11^ building said software application utilizing one of 

iaO said plurality of computer systems to create a build 

i3» version of said software application; 

1*2? automatically transmitting an initialization event 

is-J to said work flow manager utilizing said one of said 

1^=1 plurality of computer systems to start execution of an 

i7p initialization test phase in response to a completion of 

i8g said build version of said software application. 

i~ 26. The method according to claim 25, further comprising 

2 the step of during said step of building said software 

3 application, preparing said automated test environment to 

4 execute a plurality of tests on said software 
s application. 

1 27. A method in a data processing system including an 

2 automated software test environment for automatically 

3 testing a software application utilizing a plurality of 

4 tests, said method comprising the steps of: 

5 establishing a work flow manager for automatically 
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managing said automated software test environment, said 
automated software test environment including a plurality 
of computer systems coupled to a server computer system 
utilizing a network, said work flow manager being 
executed utilizing said server computer system; 

building said software application utilizing a build 
computer system to create a build version of said 
software application; 

copying said build version of said software 
application from said build computer system to one of 
said plurality of computer systems; and 

automatically transmitting an installation event to 
said work flow manager utilizing said build computer 
system to start execution of an installation test phase 
in response to said copying of said build version to said 
one of said plurality of computer systems. 

28. The method according to claim 27, further comprising 
the step of installing a plurality of test cases on one 
of said plurality of computer systems in response to a 
receipt of said installation event. 

29. The method according to claim 27, further comprising 
the step of installing an operating system required to 
execute one of said plurality of tests on one of said 
plurality of computer systems in response to a receipt of 
said installation event. 
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30. The method according to claim 27, further comprising 
the step of installing a plurality of test tools required 
to execute one of said plurality of tests on one of said 
plurality of computer systems in response to a receipt of 
said installation event. 

31. A method in a data processing system including an 
automated software test environment for automatically 
testing a software application, said method comprising 
the steps of : 

establishing an event-driven work flow manager for 
automatically managing said automated software test 
environment in response to a receipt of events, said 
automated software test environment including a plurality 
of computer systems coupled to a server computer system 
utilizing a network, said work flow manager being 
executed utilizing said server computer system; 

executing a plurality of tests on said software 
application utilizing said plurality of computer systems 
being managed by said work flow manager; 

in response to a completion of one of said plurality 
of tests, executing a validation procedure to validate a 
result of said one of said plurality of tests; 

suspending execution of others of said plurality of 
tests being executed in response to a failure of said 
validation procedure to validate said result of said one 
of said plurality of tests; and 
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providing a notification of said suspension of 
execution. 

32. A method in a data processing system including an 
automated software test environment for automatically 
testing a software application, said method comprising 
the steps of: 

establishing an event-driven work flow manager for 
automatically managing said automated software test 
environment in response to a receipt of events, said 
automated software test environment including a plurality 
of computer systems coupled to a server computer system 
utilizing a network, said work flow manager being 
executed utilizing said server computer system; 

executing a plurality of tests on said software 
application utilizing said plurality of computer systems 
being managed by said work flow manager; 

in response to a completion of one of said plurality 
of tests, executing a validation procedure to validate a 
result of said one of said plurality of tests; 

terminating execution of others of said plurality of 
tests being executed in response to a failure of said 
validation procedure to validate said result of said one 
of said plurality of tests; and 

providing a notification of said termination of 
execution . 
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33 . A method in a data processing system including an 
automated software test environment for automatically 
testing a software application, said method comprising 
the steps of: 

establishing an event -driven work flow manager for 
automatically managing said automated software test 
environment in response to a receipt of events, said 
automated software test environment including a plurality 
of computer systems coupled to a server computer system 
utilizing a network, said work flow manager being 
executed utilizing said server computer system; 

executing a plurality of tests on said software 
application utilizing said plurality of computer systems 
being managed by said work flow manager; 

in response to a completion of one of said plurality 
of tests, executing a validation procedure to validate a 
result of said one of said plurality of tests; 

spawning a new process in response to said execution 
of a validation procedure to determine a result of 
execution of said one of said plurality of tests; and 

reporting a result of said spawned new process, 
wherein said result of execution of said one of said 
plurality of tests is reported. 

34 . A data processing system including an automated 
software test environment for automatically testing a 
software application, said data processing system 
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comprising : 

means for establishing a work flow manager for 
automatically managing said automated software test 
environment, said automated software test environment 
including a plurality of computer systems coupled to a 
server computer system utilizing a network, said work 
flow manager being executed utilizing said server 
computer system; 

means for establishing a plurality of ordered test 
phases to be executed in a specified order; 

means for transmitting an event to said work flow 
manager utilizing one of said plurality of computer 
systems to start execution of selected ones of said 
plurality of ordered test phases; and 

means for controlling execution of said selected 
ones of said plurality of ordered test phases utilizing 
said work flow manager in response to a receipt of 
events . 

35. The system according to claim 34, further comprising 
means for executing an initialization test phase 
utilizing said work flow manager in response to a receipt 
of a build event by said server computer system, said 
build event being generated by one of said plurality of 
computer systems utilized to build said software 
application . 
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36. The system according to claim 34, further 
comprising : 

said means for establishing a plurality of ordered 
test phases further comprising means for establishing a 
plurality of ordered test phases including an execution 
test phase for executing a plurality of tests on said 
software application; and 

means for executing a first plurality of said 
plurality of tests in series. 

37. The system according to claim 34, further 
comprising : 

said means for establishing a plurality of ordered 
test phases further comprising means for establishing a 
plurality of ordered test phases including an execution 
test phase for executing a plurality of tests on said 
software application; and 

means for executing a second plurality of said 
plurality of tests in parallel. 

38. The system according to claim 34, further 
comprising : 

said means for establishing a plurality of ordered 
test phases further comprising means for establishing a 
plurality of ordered test phases including an execution 
test phase for executing a plurality of tests on said 
software application; 
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means for executing a first plurality of said 
plurality of tests in series; and 

means for executing said first plurality of said 
plurality of tests in parallel with a fourth plurality of 
said plurality of tests. 

39. The system according to claim 34, further comprising 
means for receiving a job description utilizing said work 
flow manager, said job description including an 
identification of said software application and an 
identification of a plurality of tests to be executed on 
said software application. 

40. The system according to claim 34, wherein said means 
for establishing a plurality of ordered test phases 
further comprises means for establishing an 
initialization test phase for preparing said test 
environment for testing said software application, said 
initialization test phase capable of being executed prior 
to an availability of said software application. 

41. The system according to claim 34, wherein said means 
for establishing a plurality of ordered test phases 
further comprises means for establishing an installation 
test phase for installing test processes and said 
software application on said plurality of computer 
systems . 

42. The system according to claim 34, wherein said means 
for establishing a plurality of ordered test phases 
further comprises: 
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means for establishing an execution test phase for 
executing a plurality of tests on said software 
application; and 

means for establishing a termination test phase for 
terminating said execution of said tests. 

43. The system according to claim 34, further comprising 
means for specifying an order for executing said 
plurality of ordered test phases including specifying 
completing execution of an initialization test phase 
prior to executing an installation test phase, completing 
execution of said installation test phase prior to 
executing an execution test phase, and completing 
execution of said execution test phase prior to executing 
a termination test phase. 

44. The system according to claim 40, further comprising 
means during said initialization test phase prior to said 
software application being available, for preparing said 
automated test environment to execute said plurality of 
tests . 

45. The system according to claim 40, further comprising 
means for generating an initialization event in response 
to a completion of building said software application. 

46. The system according to claim 40, wherein said means 
prior to said availability of said software application, 
for preparing said automated test environment to execute 
said plurality of tests further comprises means for 
determining an availability of one of said plurality of 
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computer system to be utilized to execute one of said 
plurality of tests. 

47. The system according to claim 40, wherein said means 
for establishing an initialization test phase further 
comprises means for establishing an initialization test 
phase including : 

means for executing initialization test phase 
processes; 

means for building said software application; and 

means for copying said built software application to 
one of said plurality of computer systems, wherein said 
software application is available when said built 
software application is copied to one of said plurality 
of computer systems. 

48. The system according to claim 47, further comprising 
means for generating an installation event in response to 
a completion of said copying said built software 
application to one of said plurality of computer systems 
and a completion of initialization test phase processes. 

49. The system according to claim 41, wherein said means 
for establishing an installation test phase further 
comprises means for establishing an installation test 
phase including means for installing a plurality of test 
cases on one of said plurality of computer systems. 
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50. The system according to claim 41, wherein said means 
for establishing an installation test phase further 
comprises means for installing an operating system 
required to execute one of said plurality of tests on one 
of said plurality of computer systems. 

51. The system according to claim 41, wherein said means 
for establishing an installation test phase further 
comprises means for installing a plurality of test tools, 
required to execute one of said plurality of tests on one 
of said plurality of computer systems. 

52. The system according to claim 42, wherein said means 
for establishing an execution test phase further 
comprises means for establishing an execution test phase 
including means for executing said plurality of tests. 

53. The system according to claim 42, wherein said means 
for establishing a termination test phase further 
comprises means for establishing a termination test phase 
including means for resetting said automated test 
environment to an original state. 

54. The system according to claim 34, further comprising 
means for establishing a validation procedure including: 

means for suspending execution of said plurality of 
tests prior to a completion of said plurality of tests; 
and 

means for providing a notification of said 
suspension. 
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55. The system according to claim 34, further comprising 
means for establishing a validation procedure including: 

means for terminating execution of said plurality of 
tests prior to a completion of said plurality of tests; 
and 

means for providing a notification of said 
termination. 

56. The system according to claim 34, further comprising 
means for establishing a validation procedure including: 

means for executing a process to determine a result 
of an execution of each said plurality of tests; and 

means for reporting said result. 

57. The system according to claim 34, wherein said means 
for establishing a plurality of ordered test phases 
further comprises means for establishing a plurality of 
ordered test phases, at least each of two of said 
plurality of order test phases being executed utilizing 
different ones of said plurality of computer systems. 

58. A data processing system including an automated 
software test environment for automatically testing a 
software application utilizing a plurality of tests, 
comprising : 



means for establishing a work flow manager for 
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automatically managing said automated software test 
environment, said automated software test environment 
including a plurality of computer systems coupled to a 
server computer system utilizing a network, said work 
flow manager being executed utilizing said server 
computer system; 

means for building said software application 
utilizing one of said plurality of computer systems to 
create a build version of said software application; 

means for automatically transmitting an 
initialization event to said work flow manager utilizing 
said one of said plurality of computer systems to start 
execution of an initialization test phase in response to 
a completion of said build version of said software 
application . 

59. The system according to claim 58, further comprising 
means during said means for building said software 
application, for preparing said automated test 
environment to execute a plurality of tests on said 
software application . 

60. A data processing system including an automated 
software test environment for automatically testing a 
software application utilizing a plurality of tests, 
comprising : 

means for establishing a work flow manager for 
automatically managing said automated software test 
environment, said automated software test environment 
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including a plurality of computer systems coupled to a 
server computer system utilizing a network, said work 
flow manager being executed utilizing said server 
computer system; 

means for building said software application 
utilizing a build computer system to create a build 
version of said software application; 

means for copying said build version of said 
software application from said build computer system to 
one of said plurality of computer systems; and 

means for automatically transmitting an installation 
event to said work flow manager utilizing said build 
computer system to start execution of an installation 
test phase in response to said copying of said build 
version to said one of said plurality of computer 
systems . 

61. The system according to claim 60, further comprising 
means for installing a plurality of test cases on one of 
said plurality of computer systems in response to a 
receipt of said installation event. 

62. The system according to claim 60, further comprising 
means for installing an operating system required to 
execute one of said plurality of tests on one of said 
plurality of computer systems in response to a receipt of 
said installation event. 
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63. The system according to claim 60, further comprising 
means for installing a plurality of test tools required 
to execute one of said plurality of tests on one of said 
plurality of computer systems in response to a receipt of 
said installation event. 

64. A data processing system including an automated 
software test environment for automatically testing a 
software application, comprising: 

means for establishing an event-driven work flow 
manager for automatically managing said automated 
software test environment in response to a receipt of 
events, said automated software test environment 
including a plurality of computer systems coupled to a 
server computer system utilizing a network, said work 
flow manager being executed utilizing said server 
computer. system; 

means for executing a plurality of tests on said 
software application utilizing said plurality of computer 
systems being managed by said work flow manager; 

means responsive to a completion of one of said 
plurality of tests, for executing a validation procedure 
to validate a result of said one of said plurality of 
tests ; 

means for suspending execution of others of said 
plurality of tests being executed in response to a 
failure of said validation procedure to validate said 
result of said one of said plurality of tests; and 
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means for providing a notification of said 
suspension of execution. 

65. A data processing system including an automated 
software test environment for automatically testing a 
software application, comprising: 

means for establishing an event -driven work flow 
manager for automatically managing said automated 
software test environment in response to a receipt of 
events, said automated software test environment 
including a plurality of computer systems coupled to a 
server computer system utilizing a network, said work 
flow manager being executed utilizing said server 
computer system; 

means for executing a plurality of tests on said 
software application utilizing said plurality of computer 
systems being managed by said work flow manager; 

means responsive to a completion of one of said 
plurality of tests, for executing a validation procedure 
to validate a result of said one of said plurality of 
tests ; 

means for terminating execution of others of said 
plurality of tests being executed in response to a 
failure of said validation procedure to validate said 
result of said one of said plurality of tests; and 

means for providing a notification of said 
termination of execution. 
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66. A data processing system including an automated 
software test environment for automatically testing a 
software application, comprising: 

means for establishing an event -driven work flow 
manager for automatically managing said automated 
software test environment in response to a receipt of 
events, said automated software test environment 
including a plurality of computer systems coupled to a 
server computer system utilizing a network, said work 
flow manager being executed utilizing said server 
computer system; 

means for executing a plurality of tests on said 
software application utilizing said plurality of computer 
systems being managed by said work flow manager; 

means responsive to a completion of one of said 
plurality of tests, for executing a validation procedure 
to validate a result of said one of said plurality of 
tests; 

means for spawning a new process in response to said 
execution of a validation procedure to determine a result 
of execution of said one of said plurality of tests; and 

means for reporting a result of said spawned new 
process, wherein said result of execution of said one of 
said plurality of tests is reported. 
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67. A computer program product including an automated 
software test environment for automatically testing a 
software application, said computer program product 
comprising : 

instruction means for establishing a work flow 
manager for automatically managing said automated 
software test environment, said automated software test 
environment including a plurality of computer systems 
coupled to a server computer system utilizing a network, 
said work flow manager being executed utilizing said 
server computer system; 

instruction means for establishing a plurality of 
ordered test phases to be executed in a specified order; 

instruction means for transmitting an event to said 
work flow manager utilizing one of said plurality of 
computer systems to start execution of selected ones of 
said plurality of ordered test phases; and 

instruction means for controlling execution of said 
selected ones of said plurality of ordered test phases 
utilizing said work flow manager in response to a receipt 
of events. 

68. The computer program product according to claim 67, 
further comprising instruction means for executing an 
initialization test phase utilizing said work flow 
manager in response to a receipt of a build event by said 
server computer system, said build event being generated 
by one of said plurality of computer systems utilized to 
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build said software application. 

69. The computer program product according to claim 67, 
further comprising: 

said instruction means for establishing a plurality 
of ordered test phases further comprising instruction 
means for establishing a plurality of ordered test phases 
including an execution test phase for executing a 
plurality of tests on said software application; and 

instruction means for executing a first plurality of 
said plurality of tests in series. 

70. The computer program product according to claim 67, 
further comprising: 

said instruction means for establishing a plurality 
of ordered test phases further comprising instruction 
means for establishing a plurality of ordered test phases 
including an execution test phase for executing a 
plurality of tests on said software application; and 

instruction means for executing a second plurality 
of said plurality of tests in parallel. 

71. The computer program product according to claim 67, 
further comprising: 

said instruction means for establishing a plurality 
of ordered test phases further comprising instruction 
means for establishing a plurality of ordered test phases 
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including an execution test phase for executing a 
plurality of tests on said software application; 

instruction means for executing a first plurality of 
said plurality of tests in series; and 

instruction means for executing said first plurality 
of said plurality of tests in parallel with a fourth 
plurality of said plurality of tests. 

72. The computer program product according to claim 67, 
further comprising instruction means for receiving a job 
description utilizing said work flow manager, said job 
description including an identification of said software 
application and an identification of a plurality of tests 
to be executed on said software application. 

73. The computer program product according to claim 67, 
wherein said instruction means for establishing a 
plurality of ordered test phases further comprises 
instruction means for establishing an initialization test 
phase for preparing said test environment for testing 
said software application, said initialization test phase 
capable of being executed prior to an availability of 
said software application. 

74. The computer program product according to claim 67, 
wherein said instruction means for establishing a 
plurality of ordered test phases further comprises 
instruction means for establishing an installation test 
phase for installing test processes and said software 
application on said plurality of computer systems. 
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75. The computer program product according to claim 67, 
wherein said instruction means for establishing a 
plurality of ordered test phases further comprises: 

instruction means for establishing an execution test 
phase for executing a plurality of tests on said software 
application; and 

instruction means for establishing a termination 
test phase for terminating said execution of said tests. 

76. The computer program product according to claim 67, 
further comprising instruction means for specifying an 
order for executing said plurality of ordered test phases 
including specifying completing execution of an 
initialization test phase prior to executing an 
installation test phase, completing execution of said 
installation test phase prior to executing an execution 
test phase, and completing execution of said execution 
test phase prior to executing a termination test phase. 

77. The computer program product according to claim 73, 
further comprising instruction means during said 
initialization test phase prior to said software 
application being available, for preparing said automated 
test environment to execute said plurality of tests. 

78. The computer program product according to claim 73, 
further comprising instruction means for generating an 
initialization event in response to a completion of 
building said software application. 
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79. The computer program product according to claim 73, 
wherein said instruction means prior to said availability 
of said software application, for preparing said 
automated test environment to execute said plurality of 
tests further comprises instruction means for determining 
an availability of one of said plurality of computer 
system to be utilized to execute one of said plurality of 
tests . 

80. The computer program product according to claim 73, 
wherein said instruction means for establishing an 
initialization test phase further comprises instruction 
means for establishing an initialization test phase 
including: 

instruction means for executing initialization test 
phase processes; 

instruction means for building said software 
application; and 

instruction means for copying said built software 
application to one of said plurality of computer systems, 
wherein said software application is available when said 
built software application is copied to one of said 
plurality of computer systems. 

81. The computer program product according to claim 80, 
further comprising instruction means for generating an 
installation event in response to a completion of said 
copying said built software application to one of said 
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plurality of computer systems and a completion of 
initialization test phase processes. 

82. The computer program product according to claim 74, 
wherein said instruction means for establishing an 
installation test phase further comprises instruction 
means for establishing an installation test phase 
including instruction means for installing a plurality of 
test cases on one of said plurality of computer systems. 

83. The computer program product according to claim 74, 
wherein said instruction means for establishing an 
installation test phase further comprises instruction 
means for installing an operating system required to 
execute one of said plurality of tests on one of said 
plurality of computer systems. 

84. The computer program product according to claim 74, 
wherein said instruction means for establishing an 
installation test phase further comprises instruction 
means for installing a plurality of test tools required 
to execute one of said plurality of tests on one of said 
plurality of computer systems. 

85. The computer program product according to claim 75, 
wherein said instruction means for establishing an 
execution test phase further comprises instruction means 
for establishing an execution test phase including 
instruction means for executing said plurality of tests. 

86. The computer program product according to claim 75, 
wherein said instruction means for establishing a 
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termination test phase further comprises instruction 
means for establishing a termination test phase including 
instruction means for resetting said automated test 
environment to an original state. 

87. The computer program product according to claim 67, 
further comprising instruction means for establishing a 
validation procedure including: 

instruction means for suspending execution of said 
plurality of tests prior to a completion of said 
plurality of tests; and 

instruction means for providing a notification of 
said suspension. 

88. The computer program product according to claim 67, 
further comprising instruction means for establishing a 
validation procedure including: 

instruction means for terminating execution of said 
plurality of tests prior to a completion of said 
plurality of tests; and 

instruction means for providing a notification of 
said termination. 

89. The computer program product according to claim 67, 
further comprising instruction means for establishing a 
validation procedure including: 

instruction means for executing a process to 
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determine a result of an execution of each said plurality 
of tests; and 

instruction means for reporting said result. 

90. The computer program product according to claim 67, 
wherein said instruction means for establishing a 
plurality of ordered test phases further comprises 
instruction means for establishing a plurality of ordered 
test phases, at least each of two of said plurality of 
order test phases being executed utilizing different ones 
of said plurality of computer systems. 

91. A computer program product including an automated 
software test environment for automatically testing a 
software application utilizing a plurality of tests, 
comprising : 

instruction means for establishing a work flow 
manager for automatically managing said automated 
software test environment, said automated software test 
environment including a plurality of computer systems 
coupled to a server computer system utilizing a network, 
said work flow manager being executed utilizing said 
server computer system; 

instruction means for building said software 
application utilizing one of said plurality of computer 
systems to create a build version of said software 
application; 

instruction means for automatically transmitting an 
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initialization event to said work flow manager utilizing 
said one of said plurality of computer systems to start 
execution of an initialization test phase in response to 
a completion of said build version of said software 
application . 

92. The computer program product according to claim 91, 
further comprising instruction means during said 
instruction means for building said software application, 
for preparing said automated test environment to execute 
a plurality of tests on said software application. 

93. A computer program product including an automated 
software test environment for automatically testing a 
software application utilizing a plurality of tests, 
comprising : 

instruction means for establishing a work flow 
manager for automatically managing said automated 
software test environment, said automated software test 
environment including a plurality of computer systems 
coupled to a server computer system utilizing a network, 
said work flow manager being executed utilizing said 
server computer system; 

instruction means for building said software 
application utilizing a build computer system to create a 
build version of said software application; 

instruction means for copying said build version of 
said software application from said build computer system 
to one of said plurality of computer systems; and 
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instruction means for automatically transmitting an 
installation event to said work flow manager utilizing 
said build computer system to start execution of an 
installation test phase in response to said copying of 
said build version to said one of said plurality of 
computer systems . 

94. The computer program product according to claim 93, 
further comprising instruction means for installing a 
plurality of test cases on one of said plurality of 
computer systems in response to a receipt of said 
installation event . 

95. The computer program product according to claim 93, 
further comprising instruction means for installing an 
operating system required to execute one of said 
plurality of tests on one of said plurality of computer 
systems in response to a receipt of said installation 
event . 

96. The computer program product according to claim 93, 
further comprising instruction means for installing a 
plurality of test tools required to execute one of said 
plurality of tests on one of said plurality of computer 
systems in response to a receipt of said installation 
event . 

97. A computer program product including an automated 
software test environment for automatically testing a 
software application, comprising: 

instruction means for establishing an event -driven 
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work flow manager for automatically managing said 
automated software test environment in response to a 
receipt of events, said automated software test 
environment including a plurality of computer systems 
coupled to a server computer system utilizing a network, 
said work flow manager being executed utilizing said 
server computer system; 

instruction means for executing a plurality of tests 
on said software application utilizing said plurality of 
computer systems being managed by said work flow manager; 

instruction means responsive to a completion of one 
of said plurality of tests, for executing a validation 
procedure to validate a result of said one of said 
plurality of tests; 

instruction means for suspending execution of others 
of said plurality of tests being executed in response to 
a failure of said validation procedure to validate said 
result of said one of said plurality of tests; and 

instruction means for providing a notification of 
said suspension of execution. 

98. A computer program product including an automated 
software test environment for automatically testing a 
software application, comprising: 

instruction means for establishing an event -driven 
work flow manager for automatically managing said 
automated software test environment in response to a 
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receipt of events, said automated software test 
environment including a plurality of computer systems 
coupled to a server computer system utilizing a network, 
said work flow manager being executed utilizing said 
server computer system; 

instruction means for executing a plurality of tests 
on said software application utilizing said plurality of 
computer systems being managed by said work flow manager; 

instruction means responsive to a completion of one 
of said plurality of tests, for executing a validation 
procedure to validate a result of said one of said 
plurality of tests; 

instruction means for terminating execution of 
others of said plurality of tests being executed in 
response to a failure of said validation procedure to 
validate said result of said one of said plurality of 
tests; and 

instruction means for providing a notification of 
said termination of execution. 

99. A computer program product including an automated 
software test environment for automatically testing a 
software application, comprising: 

instruction means for establishing an event-driven 
work flow manager for automatically managing said 
automated software test environment in response to a 
receipt of events, said automated software test 
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environment including a plurality of computer systems 
coupled to a server computer system utilizing a network, 
said work flow manager being executed utilizing said 
server computer system; 

instruction means for executing a plurality of test 
on said software application utilizing said plurality of 
computer systems being managed by said work flow manager 

instruction means responsive to a completion of one 
of said plurality of tests, for executing a validation 
procedure to validate a result of said one of said 
plurality of tests; 

instruction means for spawning a new process in 
response to said execution of a validation procedure to 
determine a result of execution of said one of said 
plurality of tests; and 

instruction means for reporting a result of said 
spawned new process, wherein said result of execution of 
said one of said plurality of tests is reported. 



